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Abstract 

We extend the approach of Aizenman, Sims and Starr for the 
SK-type models to their spherical versions. Such an extension has 
already been performed for diluted spin glasses. The factorization 
property of the optimal structures found by Guerra for the SK model, 
which holds for diluted models as well, is verified also in the case of 
spherical systems, with the due modifications. Hence we show that 
there are some common structural features in various mean field 
spin models. These similarities seem to be quite paradigmatic, and 
we summarize the various techniques typically used to prove the 
structural analogies and to tackle the computation of the free energy 
per spin in the thermodynamic limit. 

Key words and phrases: spin glasses, diluted spin glasses, optimization 
problems, spherical models, overlap structures. 



1 Introdution 

Aizenman, Sims and Starr introduced in 1] an approach to models of the 
type of Sherrington-Kirkpatrick (SK) of mean field spin glasses which is 
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based on very physical ideas. Their method consists of introducing an aux- 
iliary system to be coupled to the original one, and use it to generate trial 
order parameters and to find a general form for the trial free energy that 
bounds the actual one. They also find that the existence of thermodynamic 
limit of the free energy suggests the expression of an optimal trial free en- 
ergy, which is difficult to compute but ensures an Extended Variational 
Principle: the exact free energy is obtained as an infimum in a suitable 
space. This approach explains in a sense the structure of the model: its 
main parameters, the form of the trial free energy, the trial order parame- 
ters, the probability space in which one has to search for the optimal trial 
free energy. In other words, the method tells us what is the correct phys- 
ical approach to the model, i.e. coupling it to a general auxiliary system 
with the proper features. Guerra found in [5] a way to restrict the space in 
which one has to work by proving some invariance properties of the optimal 
structures. The whole approach seemed to rely heavily on the Gaussian 
nature of the couplings. On the contrary, being a very physical approach, it 
turned out to be quite paradigmatic, once the proper techniques for various 
other models were found ([HIE])- As a matter of fact, not only the same 
approach works when the model is diluted and loses the Gaussian nature 
of the couplings, but we prove here that making the model spherical either 
does not affect its structure. The most important starting point has to be 
a simpler one, though. If the method is paradigmatic it must work first of 
all in the simple case of the non-disordered version of the SK model: the 
mean field ferromagnet, that should be analogous to disordered systems 
from the structural point of view. This is quite the case (JOj)) of course, 
as we will see. 

The main idea is always to replace the quadratic dependance of the 
Hamiltonians on the main physical quantity (magnetization, overlap, etc.) 
by a linear approximation with suitable coefficients, generated by the auxil- 
iary structure. Hence one compares quadratically the main physical quan- 
tity of the original system with the trial one coming from the auxiliary 
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system, and this leads to a free energy given by the difference of an en- 
tropy term and an internal energy term. This offers important results for 
a large class of models, but one needs to find the proper technique to prove 
analogous theorems for different models. 

We will start with the description of the approach in the case of the 
Curie- Weiss (CW) mean field fcrromagnct, which provides a stereotypical 
example. Wc then show how the same method applies to the SK model 
and its spherical version. Lastly, we explain how and why the same results 
extend to diluted models, including Optimization problems. 

2 Mean Field Model of Ferromagnets 

The Curie- Weiss Hamiltonian is 



defined on Ising spin configurations a : i — ►<7j = ±l,i = l,...,iV. The 
coupling strength J is a positive constant. Defining the magnetization per 
spin of the configuration a as 




i<j 




the Hamiltonian can then be written as 




(a) = -N\ Jm\a) , 



so that the partition function is by definition 




M 



and the free energy is 



-/?/ = lim -(3f N = lim — In Z N , 
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omitting the dependence on 0. Notice the following fundamental formula 
and keep it in mind for later 

d^lnZ N (j3) = ±J{m 2 ) ; (1) 

here (•) denotes the Boltmann-Gibbs average. 

2.1 Magnetization Structures and the Comparison Method 

Consider some discrete space S, some weights £ r , r S £ and a magnetiza- 
tion kernel rh : E 2 — > [—1,1]. The triple (£,£,m) is called Magnetization 
Structure (MaSt). Then for a given MaSt M. define the trial function 

„ tKAS 1 , E ff ,rCrexp(/3J7Vmm) 

g ^ ) = ]v ta E^i(P^ (2) 

The idea is to compare the trial magnetization fn with the actual magne- 
tization of the original system. In the simple case of the CW model we 
do not need such a rich structure, but it serves as an introduction to the 
methods. For a very formal treatment of such methods for classical spin 
systems, an excellent reference is |LS| . 

2.1.1 Generalized MaSt bound 

Consider the following special MaSt M.m- Let £ be any space and £ be 
any weights in this space. Take an auxiliary CW system of M spins, with 
one-body interactions, i.e. with Hamiltonian linear in the magnetization. 
Assume the coupling is still J, and the temperature is /3. It is easy to 
compute the mean magnetization rh in this system 

rh = tanh (3 J , 

which we can modulate between zero and one by changing the temperature 
(or equivalently the strength of the couplings). Now take this fixed value 
rh (constant over all X) as the trial magnetization of our MaSt Mm, and 
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plug it into J2J). We get 

Gjv(M^) = ^ In J2 C MP JNmrh) - i lncxp(i/3J7Vm 2 ) (3) 

since to does not depend on the points r 6 E. Notice that NG N{Mm) 
coincides with the logarithm of the partition function Z(H^ W (m 2 )), pro- 
vided we replace the squared magnetization m 2 with the trivial quadratic 
estimate to 2 > 2mm — to 2 which, as Gjv(A'lm) is easy to compute, brings 
the consequent inequality, holding for all N 

■i In Zjy (/3) > sup{ln2 + lncosh(/3Jm) - \f3Jm 2 } = supG N (M,%) . (4) 

Notice that Gat (.Ma) does not depend on N. Physically speaking, we 
replaced the two-body interaction, which is difficult to deal with, with a 
one-body interaction. Then we try to compensate this by modulating the 
field acting on each spin by means of a trial fixed magnetization (entropy 
term), and a correction term (the internal energy), quadratic in this trial 
magnetization m. 

In general, we can state (see also ^31 f° r a different perspective) the 
following 

Theorem 1 For any value of N £ N, the trial function Gn defined by 10 
is a lower bound for the pressure — (5Jm of the CW model 

-f3f N >supG N (M) , (5) 

M 

Let us emphasize that a fundamental property of the CW model is that, 
for any m (non constant on £ in general), the inequality 

to > 2mm — m 2 (6) 

implies a correspondent inequality for the free energy per spin. 

Another fundamental application of the fact that convex inequalities for 
the magnetization imply inequalities for the free energy is the proof of the 
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existence of the thermodynamic limit of the free energy per spin (' |lllll3j '). 
The proof relies on considering two CW systems, one with N spins and 
another one with M spins, then comparing these two independent systems 
with the system consisting of the union of the two, which is a CW model 
with N + M spins. 

2.1.2 Reversed bound and variational principle 

The just mentioned existence of the thermodynamic limit of the free energy 
density, guarantees that the following Cesaro limit offers the value of such 
a limit 

Now assume M » N. Clearly Zm+n splits into the sum of three terms. 
One contains the interactions between spins in the big system, one contains 
the interactions between one spin in the big system and one in the small 
system, one contains the interactions between spins in the small system. 
The latter is negligible (by convexity arguments). This means that the spins 
in the small system are decoupled by the addition of the large system, and 
they do not interact one another (in the M-limit). If we take the term with 
the interactions within the large system (or cavity) as the weight ( T , t as 
the spin configuration in E = { — 1, +1} M , then the left hand side of J7J) is 
the trial function Gn(.Mb{M)) (which does not depend on N) with the 
special choice just described, called Boltzmann MaSt A4b(M). In fact, the 
Boltzmann factor in the denominator with Zjq can be written as £ times a 
properly renormalized CW Hamiltonian, like in So we get the following 



Theorem 2 (Reversed Bound) If we plug the Boltzmann MaSt Mb (M) 
just defined above into the trial function Gn defined by J2J), then the Boltz- 
mann trial function Gn(Mb{M)) provides, in the thermodynamic limit, 
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an upper bound for the CW pressure —f3f 

~Pf < lim limsup G N {Mb (M)) = lim G N (M B ) , 

as a consequence of 

-pf = C lim i- In Za ^ +N < limsup limsup G(Mb(M)) = G{M B ) ■ (8) 
m N Zm n m 

Therefore we have the reversed bound to 101, and thus the following 

Theorem 3 (Extended Variational Principle) Taking the supremum, 
for each TV separately, of the trial function Gn{M.) over the whole MaSt 
space, the resulting sequence tends to the limiting pressure — j3f of the CW 
model as N tends to infinity 

-Pf = limsup G N (M) . (9) 

N M 

In order to compute explicitly /, one can proceed as follows (^H])- Let 
us notice that the magnetization m can take only 2N + 1 distinct values. 
We can therefore split the partition function into sums over configurations 
with constant magnetization in the following way 

Zn(P) = E E S mfne^ JmfhN <= E = 1 • ( 10 ) 

ex m m 

Now inside the sum m = rh, or better m 2 — m 2 , which means also m 2 — 
2mm — m 2 . Plugging such a quadratic equality into Z^{p) and using the 
trivial inequality S m7 % < 1 yields 

z N {p) <Y^J2 e0JNmrhe ' l2PJNrh2 ■ 

rh a 

But this clearly means that 

Zn(P) < E su P{ ln2 + hicosh(/3JTO) - l-PJm 2 } 

rh & 

m 

from which 

— \nZ N (/3) < ln ( 2iV+ jj + sup {ln2 + In cosh(/3 Jfh) - -/3Jm 2 } . 
N N m 2 
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This gives, together with 10} , the exact value of free energy per site at 
least in the thermodynamic limit. The presence of the correction term 
ln(2iV + 1)/N is typical of these kinds of bounds, and as a consequence one 
can usually get the exact value of the free energy only in the thermodynamic 
limit (but compare to Proposition 5 in ^3] for the special case of classical 
spin systems). 

2.2 Spherical Ferromagnetic Model 

The calculation of the free energy of the spherical version of the CW model 
is more involved than the Ising case just illustrated. Still, the computation 
can be performed (0) and the it can be reproduced in the framework of 
the Magnetization Structures, but we will present here in detail only the 
disordered case. 

3 Disordered Mean Field Models of Spin Glasses 

The Hamiltonian of the Sherrington-Kirkpatrick (SK) model comes from 
the CW one where we take independent centered unit Gaussian couplings 
{ Jij] as opposed to constant ones, after a proper rescaling: 



The Hamiltonian is in some sense still quadratic in the quantity that takes 
the place of the magnetization: being a centered Gaussian, the Hamiltonian 
is determined by its covariance 



where E will denotes the expectation with respect to the J. 's, and q is the 
overlap between two replicas. Notice (and compare with the analog in the 
CW model) that 




(11) 



E(H(a)H(a')) = Nq 2 {a,a') , q(a,a') = ^$>i^ 



d -E\nZ N (f3) = '-(l-(q 2 )) , 



(12) 
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where (•) denotes the composition of the Boltmann-Gibbs (Q) average 
(taken first), followed by the quenched expectation (E). The key tool em- 
ployed to make the calculation above is the Gaussian integration by parts. 

As the SK model is random (because of the random couplings) and 
the overlap plays a role similar to that of the magnetization for the CW 
model, it is expected that the analog of the MaSt for disordered model is 
the Random Overlap Structure (ROSt), given in the following 

Definition 1 A Random Overlap Structure 1Z is a triple (X, q,£) where 

• X is a discrete space; 

• £ : S — * K + is a system of random weights; 

• q : X 2 — > [0, 1], \q\ < 1 is a positive definite Overlap Kernel (equal to 
1 only on the diagonal of X 2 ). 

Now consider two families of independent centered Gaussian random 
variables H. and H, defined on X 3 7, such that 

£(^(7)^(7')) = N2q^,5 ij , E(H( 7 )H(j')) = Nq 2 ^, (13) 

and consider H = X)iLi^i cr j- Then we define, in analogy with (0), the 
Generalized Trial Function by 

G N (K, H, H) = ^Eln ^ a ' T . (14) 

N £r&-exp(-/?/r) 

At this point we can use interpolation ([H]) to prove (0) the following 

Theorem 4 (Generalized Bound) For any value of N 6 N, the trial 
function Gjv defined by l|14|) is an upper bound for the pressure — /3/jv of 
the SK model 

-P/n <miG N . 
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The proof can be found in pQ. To see why this inequality has the same 
nature as the analogous one for the CW model, i.e. (JSJ, we have to recall 
l|12|) and notice that, thanks to a differentiation with respect to the inter- 
polating parameter, the theorem above is guaranteed by the analog of © 
for the covariances of the three Hamiltonians H, H, H we used 



The same result for the CW model could be proven by interpolation too, 
but that case is so simple that interpolation would have been a further 
unnecessary complication. In order to emphasize even more the key role 
of (15} , like for the CW, let us understand that the theorem above is part 
of the following general comparison scheme (see ^3 and references 
therein). 

Theorem 5 Let Ui and C/j, for i = 1, . . . , K, be independent families of 
centered Gaussian random variables, whose covariances satisfy the inequal- 
ities for generic configurations 



E(EWj-) = S tj > E(UiUj) = S i:i ,E(UiUi) = S u = = S u , 



then for the quenched averages we have the inequality in the opposite sense 



where the Wi > are the same in the two expressions. 

The proof f|101 Hip is very simple, and based on interpolation. A very 
important application, other than the ROSt approach - which includes as 
a special realization the Parisi trial function, is the proof of the existence 
of thermodynamic limit of the free energy density (' |12Hllj ). 

Now take E = { — 1, , and denote by r the elements of E. We clearly 
have in mind an auxiliary spin systems. In fact, we also choose 



q 2 < 2qq - f . 



(15) 



Elny^ Wi exp(Uj) < Eln^ Wj exp(Uj) 
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which satisfy . Let us also chose £ r = exp(— flH^ (t)). Then, if we call 
TZb(M) the Boltzmann ROSt just defined, we can prove (pQ) the following 

Theorem 6 (Reversed Bound) If we plug the Boltzmann ROSt TZb(M) 
just defined above into the trial function Gn defined by (|14|) . then the 
Boltzmann trial function GnO^-b(M)) provides, in the thermodynamic 
limit, a lower bound for the SK pressure —f3f 

-Pf> lim liminf G N (K B (M)) = lim G N (K B ) ■ 

N—>oc M—>og N-^oc- 

Like for CW, the idea of the proof is that 

G N {K B {M)) ~ i-Eln^i <= M » N . 

From the two previous theorems we get immediately the completion of the 
analogy with CW through the following 

Theorem 7 (Extended Variational Principle) Infimizing for each N 
separately the trial function Gn (7?-) over the whole ROSt space, the re- 
sulting sequence tends to the limiting pressure — f3f of the SK model as N 
tends to infinity 

—/3f — lim inf Gn ■ 

Proving the reversed bound with the proper structure (the Parisi one) , 
is not as easy as for ferromagnets. In fact, while the magnetization is just a 
number and one can fix it without too many complications like in (|10|l . the 
overlap is a random variable. Therefore one has to introduce two replicas 
and splitting the partition function into terms with fixed overlap brings a 
lot of difficulties (USD- 
Getting back to the general approach, Guerra (||]) found the following 
factorization property of optimal ROSt's 
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Theorem 8 In the whole region where the parameters are uniquely de- 
fined, the following Cesaro limit is linear in N and a 

N 



ClimElnn M {^2eiq>[-p^2Hiai + \H}} = 

a z=l 

^V(-/5/ + y(l-<? 2 ») + y(l-<9 2 )) • (16) 



Notice that the analogous factorization holds a fortiori in the ferromag- 
netic case, where the spin are the only variables and there is no quenched 
disorder that can jeopardize the factorization. 

3.1 Generalized Random Energy Model 

The same construction we saw is reproducible in the simpler case of the 
Random Energy Model and the Generalized Random Energy Model. In this 
case the model is sufficiently simple to allow for a relatively simple proof 
of the reversed bound. For an introduction of the model and a detailed 
description of the relative ROSt approach we refer to 



be equipped with its normalized surface measure dfis N ■ With J we will 
denote again a centered unit Gaussian random variable, and any index 
or symbol appended to it will refer to independent identically distributed 
copies. For a S Sjy the Hamiltonian of the spherical model is the following 
centered Gaussian 



4 Spherical Models 



Let 



N 



S N = {a e R W : °i = N } 



i=l 



1 



l.N 
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We do not consider the presence of an external field, but all the results 
trivially extend to this case as well. By ut we mean again the Bolztmann- 
Gibbs average of any observable O : Sn — > K, that now will be of the 
form 

lu(0) = Z N X { O(a)exp(-0H)dfi S s , Z N = f cxp(-(3H)d^s N ■ 

Nothing changes in the expression of the internal energy when the model 
is taken spherical 

df ^E\nZ N = ^(l-(q 2 )) . (17) 

4.1 Generalized Bound and Extended Variational Prin- 
ciple 

When the model is spherical, we still use the ROSt defined in the previous 
section, except here the space £ in not discrete, and the two auxiliary 
Hamiltonians H and H, defined on £ 3 7 , are still Gaussian random 
variables such that 

E(^( 7 )4-( 7 ')) = N2q{ ln ')8 ij , E(tf( 7 )tf( 7 ')) = A^ 2 ( 7 , 7 ') 

and H — J2f=i Then plug the interpolating Gaussian Hamiltonian 

H t = Vt{H N + H) + ^/T~tH into 

R t = — Eln Js Ja ^ — PV tL l > . 

For most of the purposes, we can equivalently take either a G £jv (which 
is the physically natural choice, and the one we will have in mind), or 
a e M. N equipped with the product of independent Gaussian measures on 
the real line, so we will simply write integrals over a without specifying 
which choice we make. We clearly have 

Ro = G N = ^ kL^t^l ,R 1 = -0f N . (18) 



Now we can state the following 
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Theorem 9 (Generalized Bound) The trial function Gn = Ro defined 
in H18fl . for any ROSt 1Z an upper bound for the pressure, and therefore, 
for any N 

-pf N <irfG N . 
n 

Proof. Thanks to l|17|l . we can proceed by interpolation like for the SK 
model. In fact, 

!*--£«.-«•><.>, 

which gives the desired result because of (|18|l . □ 

The next definition is not exactly the expected one, as for simplicity we 
choose a handier one. 

Definition 2 The Boltzmann ROSt TZb consists of the following construc- 
tion 

• the ROSt space is £ = S S M = {x E R M : \± J^fLi xf - 1\ < e} 3 t- 

• the overlap is defined in the usual way between the spin configurations 

M 



r,r') = — Y T lT ' 
• the random weights are of the Boltzmann type 



M + N ' 

to be used together with the following auxiliary Hamiltonians 

Hi = -j= L > H - - V mtw ^ JklTkTl ■ 

k—l k.l 

The choice e = r G Sm = £ would do as well, but it would lead to a 
technically more involved problem of equivalence of ensembles. It will be 
clear that as we said we could also take the spin to be independent sym- 
metric unit Gaussian variables, and hence take r £ R M with the Gaussian 
product measure. 
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Theorem 10 (Reversed Bound) There exists an optimal ROSt that 
fulfills the reversed bound to the previous theorem, or equivalently 

-0f > lim inf G N (7l) . 

Proof. We know from Talagrand's proof of the optimality of the Parisi 
ROSt Tip ( 16 1) that 

-0f = G(K P )>w£G N (1l) 

which is enough to prove the theorem no matter what is the choice of the 
space where a and r belong to, among the three mentioned possible choices. 
But we want to understand why the statements holds from a more physical 
and geometrical point of view, using the Boltzmann structure. In a system 
of M + N spins we can call r the first M and a the other N and write 



H 



1 



M+N 



VM + N 



1,M 1,JV 
^ JklTkTl + V% ^ JkiTkOj + JijCTjlj 
kJ k<M,i<N ij 



(19) 

Thanks to the Gaussian nature of the Hamiltonians, we notice that when 
M, N -> oo 

H M+N ~ ${H M + H) (20) 

since the third term in (|19(l is negligible ( 1 ). Moreover, again from the 
property of summation of independent Gaussian variables, we have 



dH M + H~H 



M 



(21) 



Let 

^M+N 

Then 



x G 



?M+N 



1 M 

-Y 



e 



, M+N 

- y 



X? - 1 



i=M+l 



^ £ 



Z N+M = I exp(-/3H M +N) 
'si 



exp(-/3ff 



M+N ) 



Sm+n\^ 



> / exp(-0H M +N) 
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Hence we can proceed like in pQ and obtain 

-0f > liminflimmf — E M+N > G(TZ B ) > inf G(K) . 

The inequalities above rely on the following observations. The third term 
in (fH3|) is negligible (Q), the second can be replaced by H like in iffll)). the 
first is the same as the one in £ r , the denominator of G(1Zb) is the same 
as Zm, as guaranteed by (|21|l . □ 

An intuition of why the Boltzmann ROSt works and the useful region 
is where e is small is given by the following property f |17|) of the high- 
dimensional spheres 

^.feoo^— ({'^S^ - 11 > ^ U - X " > = ° 

We have established, in the final A^-limit, the reversed bound in Theo- 
rem El and hence also the following 

Theorem 11 (Extended Variational Principle) Infimizing for each N 
separately the trial function Gn(1Z) over the whole ROSt space, the result- 
ing sequence tends to the limiting pressure —0f of the spherical model as 
./V tends to infinity 

—8f = lim inf . 

Again, the reversed bound with the proper structure (the Parisi one), 
is not as easy as for ferromagnets. In fact, the complication is similar to 
that of the SK case f[rS]1. 

4.2 Factorization Property 

At the beginning of this section we gave the formula of the generalized 
trial function Gn and interpolated with the true pressure —0/n- The spin 
configurations a were therefore constrained in Sjy and were not independent 
variables. This implies that the factorization property of [H], that we saw in 
the previous section for the SK model, cannot hold any longer. But as we 



1G 



are interested in the thermodynamic limit, we can replace in H the spins a 
by independent Gaussians (and Sn by R*), and we would still get the true 
pressure —f3f at t = 1 in the limit. We would not get — /?/jv at t = 1 when 
N is finite. Now the cavity fields give place to independent terms and, 
denoting by dg{-) the Gaussian measure on the real line, the invariance of 
the optimal ROSt's of Theorem [S] is reproduced for the spherical model, 
and we can state the following 

Theorem 12 In the whole region where the parameters are uniquely de- 
fined, the following Cesaro limit is linear in N and A 2 



In the last hand side above, the free energy comes from the fact that, 
like in Boltzmann ROSt, the argument of the logarithm of G is essentially 
Zm+n /Zm exept for the temperature shift d in H20|) . which gives place to 
the second term. The third term is analogous to the second but the shift 
is produced by A. In the Boltzmann ROSt A = (3 and since H is at the 
denominator of G the last two terms mutually cancel out the only the free 
energy is left. The proof is therefore identical to that of the analogous 
theorem for the SK model ([Hj) and similar to that of Theorem ^2 that is 
why we only sketched it here. 




N 



ClimEln^ M TTexp(/3 J H' i (T i )exp(-Ai?) = 



M J - J - 



iV[-/3/ + ^(l-( (Z 2 »] + -A 2 (l-( (? 2 )) . 
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5 Dilute Spin Glasses 

Once again the spin configurations are a £ { — 1,+1} N . The Hamiltonian 
of the Viana-Bray (VB) model of dilute mean field spin glass is 

where is a Poisson random variable of mean J are independent identi- 
cally distributed copies of a random variable J with symmetric distribution, 
are independent identically distributed random variables with uniform 
distribution over 1, . . . , N. The notation is the same as in the previous sec- 
tions, except E will be the expectation with respect to all the (quenched) 
variables, i.e. all the random variables but the spins. For dilute models 
the fundamental parameter that, by means of differentiation, yields the 
expressions analogous to l(T|)- (|12|l is the degree of connectivity a (see |3] for 
detailed calculations): 

^ Eln E^exp(-/3tf) = J2 ^Etanh 2 "(/3J)(1 - (gfj) , (22) 

cr,7 n>0 

where qi n is the multi-overlap defined by 

i N 

i=l 

Notice that, despite the remarkable similarity with the analogous expres- 
sion in the case of non-dilute models, 11' I'll is not the internal energy per 
spin. 

Here the key tool employed to make this calculation, that plays the 
same role as the Gaussian integration by parts for Gaussian models, is the 
following property of the Poisson measure 7r^ (m) 

— 7r tf (m) = ((TT t ((m - 1) - 7r tc (m)) . 

So in the various models discussed so far, the tool changes according to the 
nature of the model, but the results are always pretty much alike: quadratic 
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in the the main physical quantity, i.e. the magnetization, the overlap, the 
multi-overlap. 

It should be clear now from (|22|l that the proper structure to introduce 
for diluted models is the one given in the next 

Definition 3 A Random Multi-Overlap Structure TZ is a triple (S, {q2n} 
where 

• £ is a discrete space; 

• £ : £ — * K+ is a system of random weights; 

• q2n ■ £ 2 " — > [0,1], n £ N, \q\ < 1 is a positive definite Multi-Overlap 
Kernel (equal to 1 only on the diagonal of £ 2n ), 

As expected, we also need to introduce the two random variables H (7, a; J) 
and -ff (7, q; J) such that 

^Eln^ 7 exp(-/3ff) = 2^i-Etanh 2 "(/3J)(l-(g 2 „))(23) 

7 ri>0 

^A7 Eln E^exp(-/3tf) = £^Etanh 2 "(/3J)(l-(g 2 „)) (24) 

7 n > 

to be used in the usual trial function 

r> fv\ 1 w 1 E CT ,^rexp(-/3EL^) 

Gjv(^) = — Eln — — — ^- (25) 

where Hi are independent copies of H . The identity l|22|l also suggests to 
interpolate on the connectivity in order to prove (0) the following analog 
of Theorems El and 0] 

Theorem 13 (Generalized Bound) For any value of N £ N, the trial 
function Gn defined by l|25|) is an upper bound for the pressure — /3/jv of 
the VB model 

-Pf < lim inf G N (TZ) . 
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Again, from ll'L'l) we learn that the generalized bound is in the end equiv- 
alent to the extension to all even multi-overlap of (|15|l 



itn < Iqinh-n ~ q\ n V 71 G No • (26) 

The Boltzmann RaMOSt (J3]) is defined in total analogy with the one 
in the previous section 

M 



S = {-1, 1} M 3 t , £ T = exp(-PH M ) , 9i...2n = -Jt J2 r fc 



M 



k=l 

with 

Pl a N N P 2a 

U — l j — 1 V—l 

P a N 

H=-J2 J » T ^ > ( 28 ) 

and again it yields 

Theorem 14 (Reversed Bound) If we plug the Boltzmann ROSt TZb(M) 
just defined above into the trial function Gn defined by (|25() . then the 
Boltzmann trial function Gn(1Zb(M)) provides, in the thermodynamic 
limit, a lower bound for the VB pressure —j3f 

-Pf> lim liminf G N (n B (M)) = lim G N (1Z B ) . 

AT— >0O M^OO N^rOO 

The obvious consequence is again 

Theorem 15 (Extended Variational Principle) Infimizing for each N 
separately the trial function Gn(71) over the whole ROSt space, the result- 
ing sequence tends to the limiting pressure —(3f of the SK model as N 
tends to infinity 

-f3f = lim inf G N (K) . 

The physics of dilute models is still quite obscure, and the technical diffi- 
culties prohibitive (as of now) . The rigorous calculation of the free energy 
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is still missing. Still, as we showed, the structure of dilute models is similar 
to the one of the others. See |7|^]|2] for recent progress on the subject. 
The analogy with SK is completed by the next (|3]) result 

Theorem 16 (Factorization of optimal RaMOSt's) In the whole re- 
gion where the parameters are uniquely defined, the following Cesaro limit 
is linear in N and a 

ClimElnfi M {^exp[-/3(#(a) +H(a/N))}} = N(~/3f + aA)+aA , 

(7 

where 

oo 1 N 

A = E ^Etanh 2 "(/3J)(l - (q 2 2n )) ,6=^6^. 

n—l i—l 

5.1 Optimization Problems 

We conclude by briefly describing how all we just saw extends to optimiza- 
tion problems as well. 

The Hamiltonian of the random K-SAT is a model of dilute spin glasses, 
that using the usual notations reads 

ff = -£~(i + ^i)--^(i + J> i? ) , 

where {i^} are independent identically distributed random variables, uni- 
formly distributed over points {1, . . . , TV}, {«/£} are independent identically 
distributed copies of a symmetric random variable J = ±1, 
The fundamental equation we get this time (p]) is 

ri 1 ^ ^ (-^) n + 1 /p-l 3 -^\ n 

--Eln5>expH3ff) = £ L_L_ ((1 + Q n (?))*> 

7 n>0 ^ ' 

(29) 

where 

n l,2n 

Q2n{q) = ^2 ^2 Qn-ra , <?2n+l = , n = 1,2, . . . 

(=1 rx<---<r 2 i 
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which explain why we can still the RaMOSt, provided we consider q ri ... r2l : 
E ri x • • • x £ r , — ► [0, 1] instead of the mere even multi-overlap as for the 
Viana-Bray model. 

The natural modification of the usual quantities is (0) thus 

rl 1 ^ ^ f-lV l+1 /p-P — 1\" 

Ta n E ln E ex P("^ ) = * E -^T" ) « J + a.®)* -1 ) 

7 n>0 ^ ' 

--Eln J2 & eM-PH) = (if- 1) £ ((1 + Q n (q)f) 

7 n>0 ^ ' 



and 



G N (K,H,H) = -Eln 



1 , E., T ^exp(-/3£f =1 (tf i )K 1 + ^)) 



where Hi are independent copies of H , and finally 

W ^1 



H = Y,H i -{l + J i a i ) . 
i=l 

The same interpolation on the connectivities allows one to prove the gen- 
eralized bound, which is equivalent to the non-negativity of the function 
x K — Kxy K ~ 1 + (K — l)y K of x and y. The obvious construction of 
the Boltzmann RaMOSt ([5]) is S = {— 1,1} M , using r instead of 7, 
£ T = cxp(- (3H M {r)) and 

PKa 

2''" 2 ' ' "'' ' " '-'2' 



* 1 1 1 

#r = -^-(l+i> ) i)----(l + ^W 1 )-(l+J F \) 



I/=l 

-P(/f-l)oiV 

ft = 



C-l)o« 



2 
i/=i 

where the independent random variables y are all uniformly distributed 
over 1, . . . ,M and J', J' are independent copies of J. Of course the Boltz- 
mann RaMOSt fulfills the reversed bound and leads therefore to the ex- 
tended variational principle 05 )• Lastly the same factorization property 
as usual is verified here as well (|5J). 
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6 Conclusion 

If we start from the approach of £Q for the SK model, we saw that it 
keeps its validity if we remove the disorder (passing to the CW model), if 
we dilute the model (passing to the VB), if we make the model spherical. 
The presence of an external field can easily taken into account in all cases. 
Unfortunately, the approach does not directly extend to the dilute case if 
the model is spherical or ferromagnetic (some interesting results can be 
obtained in this latter case, and we plan on reporting on this soon [B]). 
Moreover, it is not clear what to do when interactions involve an odd 
number of spins. But the main open problem is probably to understand 
which is the right extension to finite dimensional models. 
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